Adaptive Distributed Caching with Minimal Memory Usage
نویسندگان
چکیده
We have shown previously that our Adaptive Distributed Caching (ADC) algorithm is able to compete with typical hashing based approaches in the realm of distributed proxy systems. In our first approach, we allowed the algorithm to run with the assumption of unlimited system resources (e.g. physical RAM). In this paper we introduce an extension to ADC, which gives the algorithm the capability to perform in more realistic environments with limited memory. We will discuss the arising problem, introduce the new ADC and provide experimental results, which will show that our algorithm is able to achieve the performance characteristic of our previous work even with limited resources.
منابع مشابه
Adaptive Distributed Caching
This paper introduces an adaptive algorithm for distributed caching based on the idea of autonomous proxy caches without the usage of a central coordinator or broadcasting protocol. We will show, that the algorithm outperforms exist ing approaches based on hashing algorithms in hot-spot scenarios and common power-law request patterns.
متن کاملAdaptive Performance-Aware Distributed Memory Caching
Distributed in-memory caching systems such as memcached have become crucial for improving the performance of web applications. However, memcached by itself does not control which node is responsible for each data object, and inefficient partitioning schemes can easily lead to load imbalances. Further, a statically sized memcached cluster can be insufficient or inefficient when demand rises and ...
متن کاملAdaptive Compressed Caching: Design and Implementation
In this paper, we reevaluate the use of adaptive compressed caching in order to improve system performance through reduction of accesses to the backing stores. We propose a new and simple adaptability policy that adjusts the compressed cache size on-the-fly, and evaluate a compressed caching system with this policy through an implementation in a widely used operating system, Linux. We also rede...
متن کاملAdaptive Caching Algorithms for Big Data Systems
Today’s Big Data platforms have enabled the democratization of data by allowing data sharing among various data processing frameworks and applications that run in the same platform. This data and resource sharing, combined with the fact that most applications tend to access a hot set of the data has led to the development of external, in-memory, distributed caching frameworks. In this paper, we...
متن کاملAdvancement Proposal Storage Embedded Networks (SEN) and Adaptive Caching using Multiple Experts (ACME)
The gap between CPU speeds and the speed of the technologies providing the data is increasing. This causes the performance of processes to be limited by the performance of the storage devices, the networks and the buses. Furthermore, the number of CPUs that share these data access resources is growing exponentially. Caching, prefetching and parallelism are some of the techniques used today to c...
متن کامل